Neuroscience of Consciousness
◐ Oxford University Press (OUP)
Preprints posted in the last 30 days, ranked by how well they match Neuroscience of Consciousness's content profile, based on 16 papers previously published here. The average preprint has a 0.01% match score for this journal, so anything above that is already an above-average fit.
Sullivan, E. C.; McCall, C.; Croissant, M.; Henderson, L.; Schofield, G.; Cairney, S.
Show abstract
Sleep deprivation amplifies emotional reactivity to brief, overt threats in the external environment. However, its effects on emotional responses to prolonged, ambiguous threat remain unclear. In this pre-registered study, we combined virtual reality, psychophysiology and multidimensional experience sampling to test the hypothesis that sleep deprivation disrupts emotional adaptation to sustained or resolving threat. Following a night of restful sleep or total sleep deprivation, healthy young adults navigated an immersive virtual world that alternated between ambiguously threatening and non-threatening contexts. Despite initial increases in emotional arousal, sleep-rested individuals quickly downregulated affective responses to ambiguous threat, reflecting efficient adaptation to the aversive virtual environment. Sleep-deprived individuals, by contrast, were unable to overturn elevated arousal responses, and exhibited a breakdown of goal-orientated, emotional control. Interestingly, resting heart rate variability, an index of affective regulatory capacity, mitigated arousal responses to ambiguous threat after sleep deprivation. These findings suggest that insufficient sleep prevents an adaptive renormalisation of emotional arousal during prolonged and ambiguous threat, giving rise to a maladaptive state of anxiety.
Fabus, M. S.; Zerfas, S.; Gruver, A.; Fini, M.; Gadaev, T.; Devaney, K. J.
Show abstract
The use of meditation as a tool to improve human wellbeing is receiving considerable scientific interest. However, most existing research has focused on concentration-based practices. One powerful alternative is jhana meditation, which leads to states characterised by self-reinforcing bliss, potentially useful for a variety of clinical and scientific domains. However, our understanding of these states is limited by small amounts of data and poor access to experts. To enable new insights, here we release the largest to date and first open-access dataset of electroencephalographic and physiological recordings in expert Jhana meditators. This includes 100+ hours of data in N=26 subjects across three retreats, alongside a detailed description and example code illustrating analysis of the data. This open dataset release can enable wider collaboration and has the potential to move us closer to an understanding of endogenously generated altered states of consciousness.
Czajko, S.; Zorn, J.; Abdoun, O.; Margulies, D. S.; Blanke, O.; Lutz, A.
Show abstract
Nonduality is a foundational but conceptually elusive notion across several contemplative traditions. Nondual traditions challenge the assumption that a subject-object structure characteristic of ordinary experience is an intrinsic feature of conscious awareness. However, little remains known about the neurocognitive mechanisms associated with such experiential state. Here, we investigated how Open Presence (OP) meditation, a form of non-dual mindfulness practice, modulates bodily self-representation and large-scale brain functional organization. We combined the Full-Body Illusion Experience (FBIE), a virtual reality paradigm manipulating bodily self-processing, with resting-state functional connectivity gradient analyses in expert meditators (>10,000 hours of practice) and meditation novices. We hypothesized that OP would attenuate bodily self susceptibility as measured by FBIE and increase large-scale integration of functional brain networks, consistent with prior findings linking reduced self-boundaries and ego-dissolution to increased connectome integration. Seventy-five participants (28 experts, 47 novices) underwent fMRI scanning during OP meditation. Brain network organization was assessed using connectivity gradients and network dispersion/ eccentricity metrics. Group differences were evaluated using bootstrap statistics and support vector classification. Compared with novices, expert practitioners showed reduced global network eccentricity during OP, particularly within dorsal attention, ventral attention, and frontoparietal networks, suggesting greater large-scale integration of functional networks. These neural patterns were positively correlated with FBIE self-report measures and negatively with cognitive defusion scores, a construct thought to reflect reduced self-grasping toward thoughts and mental contents. Together, these findings suggest that nondual meditation is associated with alterations in self-representation and increased large-scale functional integration, providing candidate neural markers of nondual awareness.
Poyser, D.; Rodriguez Balboa, E.
Show abstract
Intense aesthetic experiences are among the most complex responses arising from the interaction of mind, brain, and context. Observations from fMRI suggest that when viewers feel highly moved by artworks, the underlying neural states differ from those accompanying less intense responses, particularly through recruitment of the DMN. Using electroencephalography and Bayesian category-specific cumulative link mixed models, we investigated whether such putative peak aesthetic responses exhibit threshold-specific neurodynamics rather than linear scaling with intensity. Twenty-two Chilean participants viewed 113 diverse local artworks whilst rating how moved they felt on a four-point scale. We analysed both canonical oscillatory power ({theta}-{gamma}) and aperiodic components (offset and exponent) during the contemplation window and the post-elicitor window. Threshold-specific effects were found: spectral features differentiated the highest rating category from moderate responses, rather than scaling uniformly across all intensity levels. During artwork visualisation, power in the {beta}1 and {beta}2 bands, as well as the interaction of {beta}1 with the 1/f exponent, predicted the transition to the most intense response; during the post-elicitor window, the aperiodic 1/f exponent predicted the transition from very low to higher-intensity responses. Modelling individual differences in spectral signatures (in the and {gamma} bands) credibly improved predictive performance (approximate leave-one-out cross-validation; elpd_loo), suggesting that neural variability reflects meaningful mechanistic heterogeneity in aesthetic processing rather than mere noise. These findings speak to a broader question, how the brain marks the intensity of conscious experience, and, more specifically, support the hypothesis that being intensely moved constitutes a qualitatively distinct neural state, characterised by specific configurations of oscillatory dynamics and cortical excitability that modulate the transition from low and moderate to peak engagement.
Nath, M.; Reggente, N.; Bailey, N.; Kringelbach, M. L.; Laukkonen, R. E.
Show abstract
Across contemplative traditions, deeper states of meditation are described as states of heightened clarity, vividness, and stillness of mind, yet what this clarity corresponds to in the brain has remained difficult to specify. The functional signal-to-noise ratio (f-SNR) framework frames mental clarity as a measurable property of neural signals: the degree to which brain activity tracks the causes of sensory signals rather than endogenous, irrelevant fluctuations. It predicts that deepening meditation should raise f-SNR, expressing sensory events more faithfully in neural signals against ongoing background activity. We tested this prediction across different levels of meditative depth. Twenty-nine experienced Vipassana practitioners meditated while auditory tones were presented, periodically reporting their depth of meditation. f-SNR was quantified from event-related potentials (ERPs) in a fronto-central P3 window and from single-trial decodability of auditory tone-evoked activity against no-tone background EEG. High-depth states were associated with greater ERP signal-to-noise ratio, stronger single-trial signal consistency, and improved decodability of auditory tones. These results suggest that meditative depth is expressed in the reproducibility and stimulus-background separability of sensory responses, consistent with deep meditation enhancing the brain's functional signal-to-noise ratio by improving the clarity of sensory signals and reducing endogenous noise.
Qu, C.; Zinchenko, A.; Chen, S.; Shi, Z.
Show abstract
Social media users often feel that time vanishes while scrolling, but real feeds confound novelty, rewards, social signals, and self-paced control, leaving the driver of this distortion unclear. We tested whether self-paced visual exploration is sufficient to compress subjective time by comparing active scrolling with passive, yoked viewing and a static baseline. Twenty-three adults viewed sequences of natural images under three within-subject conditions: Scrolling (self-paced mouse clicks), Watching (a passive, yoked replay of their own scrolling sequence), and a Baseline (a static image). Participants estimated the elapsed duration of each block. Subjective duration was most compressed under Scrolling (48% of elapsed time), followed by Watching (51%) and Baseline (65%). Two sources separated these effects. Adding back the empty inter-image fixations brought the image-rich conditions to within seconds of the Baseline, showing that observers barely counted the blank gaps; the Scrolling--Watching difference, by contrast, was independent of these shared gaps, isolating self-paced control as a second source of compression. Electrophysiology linked that control to anticipatory neural states and the timing of early visual responses, with no amplified encoding of individual images. The results favor an attention-weighted account of timing, on which subjective duration tracks how much attention reaches the clock, a resource that a self-paced stream and its uncounted gaps both draw away.
Mahfoud, D.; Najjar, R. P.
Show abstract
Light is a fundamental regulator of human physiology and behaviour. Whether prior light exposure shapes subsequent higher-order cognition and mood beyond the period of exposure remains unknown. We tested this in a within-subject, randomised crossover experiment in which 24 healthy young adult males completed a multimodal cognitive battery following 2 x15 min of full-spectrum light (FL; median 1,029 melanopic equivalent daylight illuminance [mEDI]) or standard indoor light (SL; median 234 mEDI), with all testing conducted under identical dim illumination. FL improved Digit-Symbol Substitution Test accuracy and promoted digit-directed gaze reallocation, consistent with more efficient associative encoding. On the Balloon Analogue Risk Task, FL reduced reward-seeking behaviour and suppressed backward-referencing gaze transitions linking current and prior-trial reward information. Mood declined following SL but remained stable after FL. Sustained attention, vigilance, and subjective sleepiness were unaffected. Our findings identify pre-task FL exposure as a selective primer of higher-order cognition and mood, independent of alertness.
Ventura, M.; Grootswagers, T.; Cottier, T.; Varlet, M.; Dunn, J. D.; White, D.; Quek, G. L.
Show abstract
Super-Recognisers show exceptional ability in face recognition, providing a natural model of how perceptual systems optimise for individuating visually similar stimuli in variable viewing conditions. However, the neural representations supporting this extreme perceptual expertise are unknown. Here, we tested whether Super-Recognisers (n = 23) differed from typical recognisers (n = 21) in the dimensional organisation of neural face identity coding. We recorded 64-channel electroencephalography while participants viewed random and rapidly-presented sequences containing 10 naturally varying images of 40 unfamiliar identities. Using time-resolved representational similarity analysis we measured the geometry of identity representations, their consistency across observers, and how clearly they specified face identity. Although neural expression of identity information was robust in both groups, we found three key differences between Super-Recognisers and typical recognisers. First, the geometry of face identity representations differed between groups. Second, Super-Recognisers showed greater inter-individual consistency in representational geometry. Third, Super-Recognisers' neural signals discriminated between face identities more strongly than those of typical recognisers. Differences in the coding of broader face categories (sex, age, ethnicity) were notably weaker, suggesting that the observed group differences reflected fine-scale differences in identity coding rather than global reshaping of representational geometry. Strikingly, all three differences emerged within a common mid-latency interval (~300-500ms), implicating higher-stages of face processing associated with representations that are sensitive to face familiarity and link between perceptual and semantic domains. Together, these findings indicate that individual differences in face recognition ability reflect higher-level differences in neural identity coding, rather than enhanced early sensory processing.
Reutimann, S.; Imbach, L.; Burkhard, Z.; Baumann, C. R.; Maric, A.
Show abstract
Chronic partial and acute total sleep loss have a distinct impact on sleep architecture. Namely, acute sleep deprivation primarily leads to a strong rebound of slow wave sleep, while chronic sleep restriction results in an increased propensity of REM sleep. The aim of this work was to examine whether these different effects would translate into quantifiable changes in sleep state boundaries and dynamics using a model-based method. Besides conventional sleep stage scoring, we applied an EEG model (state space approach) for dynamic analysis of nocturnal EEG recordings in 14 healthy subjects under experimental chronic sleep restriction (last of 7 nights with 5 hours of time in bed) and after acute sleep deprivation (sleep following 40 hours of wakefulness), in comparison to baseline sleep. Subjects under chronic sleep restriction revealed increased similarities in the frequency composition of REM sleep and wakefulness and thus, a decreased differentiation of state boundaries between the two behavioral states. Contrarily, acute sleep deprivation affected the spectral composition of NREM sleep. Only acute sleep deprivation resulted in more stable slow wave sleep. Our explorative study confirmed that the distinct effects of increased REM sleep and slow wave sleep propensity following acute total and chronic partial sleep loss are reflected in differential changes of behavioral state boundaries and sleep dynamics. This suggests that these sleep structure characteristics are state dependent, which may allow using such measures in the future to track treatment effects in clinical populations characterized by sleep behavioral state dysregulation.
Lanfranco, R. C.; Guterstam, A.; Cleeremans, A.
Show abstract
Eye contact is one of the most potent social signals, but it remains unclear how little visual input is sufficient to register direct gaze, and whether such registration requires conscious awareness. Here, we used a custom tachistoscope to present faces for only 1-5 ms, asking whether gaze direction can shape perception at the very limits of vision. Direct-gaze faces required less visual input to localise than averted-gaze faces and produced higher localisation sensitivity from 3 ms onwards. Crucially, this advantage emerged before participants could explicitly categorise gaze direction, and before perceptual awareness ratings showed metacognitive access to the information driving localisation, both of which appeared only at 4-5 ms. Information-theoretic analyses confirmed that localisation responses carried stimulus-location information before explicit reports and awareness ratings became informative. A second experiment showed that the earliest eye-contact advantage depended mainly on low spatial frequencies, indicating a role for coarse visual information. Finally, autistic traits were associated with a reduced localisation advantage for direct gaze. These findings show that eye contact can influence perceptual processing within just a few milliseconds, with less visual stimulation than is required for conscious access to gaze direction.
Hughes, J. D.; Doty, T. J.; Balkin, T. J.
Show abstract
The slow oscillation (SO) of non-rapid eye movement (NREM) sleep has been implicated in the restorative properties of sleep. Slow oscillatory transcranial direct current stimulation (SO-tDCS), involving a positive oscillatory current applied to the scalp at a peak frequency of 0.75 Hz, has been used to enhance SO power during NREM sleep. We examined whether enhancing SO power with SO-tDCS during a restricted nighttime sleep opportunity would accelerate the restorative properties of sleep during an otherwise insufficient sleep period and help sustain performance during subsequent extended wakefulness. A total of twenty-six healthy young adults (ages 18-39, n=16 females) completed a 15-day study. After 7 baseline nights at home and 3 baseline nights in the laboratory, participants entered the laboratory for 5 consecutive days including a baseline day, a 2-hour nighttime sleep period with participants randomized to the SO-tDCS (n=11) or SHAM (n=15) condition, 46 hours of sleep deprivation, and two recovery nights. In the SO-tDCS condition, stimulation was administered for one hour starting exactly 60 minutes after sleep onset, with intervals of five minutes of continuous stimulation followed by one minute of no stimulation. Polysomnographic recordings were conducted during each sleep period. Performance was assessed using the Psychomotor Vigilance Test (PVT) approximately every 75 minutes across baseline, sleep deprivation, and recovery. Prior to the two-hour sleep opportunity, a Paired Words Associate Task was administered. Participants listened to 54-word pairs and were asked to recall 46 of the word pairs, with up to three attempts to successfully recall at least 60% of word pairs (T0). Recall was also assessed 20- (T20) and 120-minutes (T120) after awakening from the two-hour sleep period. Data were analyzed using mixed-effects ANOVA. PVT performance (defined as mean response time and number of response times greater than 1,000 ms) significantly declined across sleep deprivation with performance degradations peaking in the early morning hours. Participants in the STIM condition demonstrated significantly better performance during sleep deprivation relative to the SHAM condition. On the PWAT, participants in the SHAM condition recalled fewer word-pairs upon awakening relative to T0. In sharp contrast, performance of participants in the SO-tDCS condition did not deteriorate at T20 and was actually improved at T120 relative to T0. We conclude that SO-tDCS can robustly accelerate the restorative properties of sleep and can additionally enhance sleep related memory consolidation when sleep opportunity is restricted.
Rosenblum, Y.; Bovy, L.; Hemmsen, M. C.; Duun-Henriksen, J.; Ahrens, E.; Dresler, M.
Show abstract
This study aimed to explore night-to-night variability of multiscale sleep patterns by analyzing subcutaneous electroencephalography (sqEEG) from 20 healthy participants over one year (205-388 nights per participant, 6,429 nights in total). We utilized the time series of aperiodic slopes, sigma and slow-wave power as a new whole-night unit of sleep macrostructure. Using dynamic time warping, we calculated the distances (differences) between those time series to assess night-to-night sleep macrostructure dissimilarity. We found that the overall sleep macrostructural patterns were relatively similar across nights (20% dissimilarity), while their temporal alignment was quite variable (time series warped by ~60% for the best alignment). Lower variation in macrostructure dissimilarity was associated with better subjective sleep quality (r=-0.25). Then, we qualitatively compared yearlong variation in macroscale, microscale (sleep stage proportions, mean spectral power) and mesoscale (sleep cycle duration) metrics. We found that intra-individual night-to-night variation was '"low (coefficients of variation < 20%) for spectral power, sleep duration, N2 and REM sleep; ''medium'' (20-40%) - for N3 and macrostructure dissimilarity; and "high" (>40%) - for sleep cycle duration, wake and N1. In summary, different sleep metrics showed differential night-to-night variability, which was more metric-specific than scale-dependent. This might reflect a distinction between more trait-like versus more dynamically varying features of sleep, although this assumption needs further clarification.
Coupette, F.; Brainard, D. H.; Smithson, H. E.; Read, D. J.
Show abstract
Fixational eye movements (FEMs) comprise the involuntary small scale eye motion conducted during fixation on a stationary stimulus. As a consequence, the visual information can be spread across multiple photoreceptors reducing the local signal-to-noise ratio. Yet, the signals transmitted by individual photoreceptors adapt to constant stimulation so that an entirely still scene would eventually fade from view. Because FEMs convert a stationary stimulus in the world to a temporally varying one on the retina, they can act to prevent this stimulus fading. Thus, FEMs can be understood as a sampling protocol than needs to be adjusted to the underlying processing circuitry. We analyse the impact of FEMs on the rate of information acquisition at the level of the retina for two common tasks of the human eye that typically go hand in hand: detection and localization. Here, we build a simple analytical model of visual perception, i.e. we subject a continuous receptor array to a stimulus moving across the retina as a consequence of FEMs with receptor excitations depending on past stimulation through a linear response function. Using Bayesian inference we quantify both the probability of detection and the accuracy of localization as a function of parameters controlling eye movements and stimulus. We find that localization of a stimulus is equivalent to the detection of the stimulus gradient. This allows us to discern optimal properties of eye movements for the respective tasks and provides a link between two typical psychophysical observables: detection thresholds and Vernier acuity. Our analysis suggests that typical human FEMs tend to facilitate localization at the expense of detection. Simply put, if you can see a stimulus you also know where it is. Finally, we propose a variety of experimental protocols to investigate the interplay between FEMs, detection, and localization with the potential of inferring intrinsic properties of an individuals visual system.
Vohryzek, J.; Lopez-Sola, E.; Yang, W. F. Z.; Sanz Perl, Y.; Potash, R. M.; Laukkonen, R. E.; Sparby, T.; Kringelbach, M. L.; Ruffini, G.; Deco, G.; Sacchet, M. D.
Show abstract
Advanced meditation offers a powerful lens for investigating consciousness and for understanding how sustained training may contribute to human flourishing. In the spirit of neurophenomenology, we combine first-person reports with model-free empirical analyses and formal whole-brain modeling to investigate the mechanisms underlying advanced meditative states and minimal phenomenal experience (MPE). Specifically, we focus on jh[a]na meditation, a type of advanced concentrative absorption meditation (ACAM-J). Advanced practitioners accessed the eight ACAM-J states during ultra-high-field 7T functional magnetic resonance imaging. For each state, we first characterize empirical functional connectivity and then build a mechanistic whole-brain model that reproduces brain activity by modeling the dynamical regimes of different brain networks. We found that the later ACAM-J states, taken here as candidates for MPE, show increased large-scale functional integration and a shift of functional network dynamics toward near-critical working points. The default mode network (DMN) exhibits the largest shift, from a distant noise-driven regime during the control condition to near-critical dynamics during ACAM-J. We also observed that the trajectory of ACAM-J states is non-linear, with prominent reconfigurations at key meditative milestones. Our results suggest that MPE, as instantiated in later ACAM-J states, corresponds to a globally susceptible state where near-critical dynamics dominate. We interpret this near-critical regime as a form of "openness", in which constrained and differentiated patterns of brain activity give way to greater flexibility. In particular, increased DMN susceptibility is correlated with broader attention and reduced narrative thought, consistent with a more flexible mode of self-related processing. In this context, advanced meditation provides a powerful model for studying how sustained contemplative practice can profoundly shape brain dynamics and provide a window into core aspects of consciousness.
Siefert, E. M.; Chen, Y. Y.; Davis, K. A.; Chen, H.-C. I.; Schapiro, A. C.; Foster, B. L.
Show abstract
Hippocampal ripples are transient, high-frequency oscillations linked to memory replay and consolidation. Ripples are well-characterized in rodents to occur during periods of behavioral inactivity (i.e., sleep, rest), viewed as "offline" states where replay can emerge with limited sensory interference. However, human studies have increasingly observed ripples during active tasks, raising the questions of whether ripple genesis and function have been misunderstood or whether there are fundamental species differences. We propose that low arousal states--predominant during offline sleep and transient during wake--may constitute a common mechanism of ripple genesis that reconciles these observations. We recorded directly from human hippocampus during sleep and wake, measuring arousal via sleep staging, pupillometry, and heart rate. Ripple occurrence consistently tracked low arousal: rates were maximal in NREM sleep, small-pupil wake states, and slow heart rate periods across sleep and wake. This modulation was stronger in anterior than posterior hippocampus and was hippocampus specific: ripple-like activity outside the hippocampus showed an opposite modulation, increasing with high arousal. These results resolve apparent species differences and provide a unifying view of offline periods as arousal dips that can emerge across behavioral states, including transiently during active wake, suggesting hippocampal ripples, and memory consolidation, occur continuously intermixed with cognition.
Keogh, R.; Isherwood, Z.; Rich, A. N.
Show abstract
Many forms of memory are thought to rely on visual imagery, but individuals who report lacking visual imagery (aphantasia) can still perform various memory tasks. There is, however, evidence that aphantasia may lead to less detailed autobiographical memories, suggesting there may be deficits in the underlying cognitive processes that support personal memories. One such process is associative memory, which requires binding of different types of information. Here, we tested whether associative visual memory is intact in aphantasia. We assessed 72 self-identified individuals with aphantasia and 77 controls who reported having visual imagery. Participants completed an associative memory task which involved memorising displays where a unique object in a specific location was associated with a particular colour fixation point. Individuals with aphantasia performed equivalently to controls for object locations and outperformed controls on the associated object-identity. In addition, whereas controls were significantly worse at remembering associated object-identity than object-location, individuals with aphantasia showed no such difference. Both groups showed good metacognitive performance evidenced by a positive correlation between confidence and accuracy; there were no significant differences in confidence between the groups. Reported strategies varied between groups: a large proportion of control participants reported using visual imagery and self-reported use of imagery positively correlated with performance. Conversely, individuals with aphantasia mostly reported using nonvisual strategies to remember the associations. Overall, the findings suggest that individuals with aphantasia can form associative memories using nonvisual strategies. Thus, difficulties with autobiographical memory in aphantasia seem unlikely to be due to fundamental issues with associative memory.
Peterzell, D. H.; Arrighi, R.; Di Cesare, C.; Gurioli, M.; Farini, a.; Grasso, P. A.
Show abstract
Numerosity adaptation (the underestimation of number after exposure to a numerous adaptor) is reduced when adaptor and test differ in color, suggesting that the numerosity system parses items into color-defined categories. Here we ask whether this chromatic selectivity is organized into multiple narrowly tuned chromatic channels, and whether its expression depends on individual chromatic sensitivity. Twenty observers (aged 22-61) completed two psychophysical tasks. First, chromatic discrimination was measured for five hues spaced in 5{degrees} CIE L*a*b* steps ({Delta}H = 0{degrees}, 5{degrees}, 10{degrees}, 15{degrees}, 20{degrees}) from a red reference (LCh: 54, 118, 38), yielding an individual just-noticeable difference (JND). Second, numerosity adaptation was measured across the same five chromatic distances between a 48-dot adaptor and the test. Observers with superior discrimination (JND < 2.5{degrees}) showed robust chromatic tuning, adaptation declining as the test moved away from the adaptor hue, whereas poorer discriminators showed none. Using an interindividual-covariance / factor-analytic approach, we found that adaptation strengths at neighboring chromatic distances were highly correlated and fell off with chromatic separation. Principal component analysis extracted two factors, one loading on the larger chromatic distances and one on the smaller; under oblique (promax) rotation the two factors were substantially correlated (r = .66), implying at least two dissociable but overlapping chromatically tuned mechanisms. These results suggest that numerosity adaptation is mediated by multiple, comparatively narrow chromatic channels, resembling the higher-order color mechanisms inferred from color scaling, SSVEP, and fMRI, rather than the two early cardinal axes (L-M, S-(L+M)).
Pan, Y.; Rabe, L.; Zander, T.; Klug, M.
Show abstract
Virtual reality (VR) interaction remains largely dependent on explicit motor input, limiting seamless and adaptive interaction. This study investigated whether electroencephalography (EEG)-based passive brain-computer interfaces (BCIs), combined with eye gaze, can decode interaction intent directly from its underlying neurophysiological correlates during dynamic VR gameplay. We operationalized interaction intent as comprising two components: affordance-related evaluation, indicating whether an attended object affords interaction, and approach-avoidance evaluation, indicating the directional tendency of interaction toward desirable or undesirable outcomes. Twenty-three participants completed a VR game with two calibration sessions and one online BCI session. Offline analyses showed above-chance decoding of the binary approach-avoidance decision classification across all actionable trials, with a grand-average accuracy of 66.28% across participants. This decoding transferred to online closed-loop gameplay, where grand-average accuracy remained above chance at 69.64%. Category-level analyses further revealed substantial variability in classification separability. For approach-avoidance-related classifications, accuracy reached 80.84% for the most distinct pairing between clearly valenced reward and punishment categories, but dropped to near chance at 59.03% for the more context-dependent pairing with ambiguous motivational valence. Affordance-related classifications between non-actionable and actionable item categories were consistently high, ranging from 77.76% to 83.50%. User Experience questionnaire results showed that, despite limitations leading to perceived loss of control and reduced ease of use, participants found the BCI-based interaction paradigm itself more fun than the controller baseline. To our knowledge, this is the first demonstration of real-time EEG decoding of interaction intent during dynamic VR gameplay, contributing toward intuitive user-adapted interfaces driven by physiological signals in immersive environments.
Malik, A.; Kolmel, L.; Billino, J.; Doerschner, K.
Show abstract
Humans rely on multiple sensory modalities, such as vision, audition, and touch, to perceive materials in everyday life. Previous research shows that multisensory perception leads to facilitation, yet the mechanisms responsible for this facilitation remain poorly understood. One potential mechanism is crossmodal prediction, whereby input from one modality generates predictions about another. While substantial research on multisensory facilitation has focused on bottom-up processes, such as spatial, temporal, and semantic congruency, the role of crossmodal predictions, particularly in material perception, has received little attention. To address this gap, we conducted two experiments, a reaction time task and a material rating task, in which participants viewed computer-generated animations of familiar objects being dropped to the ground. The paradigm exploited the natural temporal structure of impact events: pre-impact visual appearance provides information about an objects material and therefore can generate expectations about the forthcoming impact sound. Critically, participants saw the event only until before the impact, after which the video was masked. Thus, vision and audition were temporally aligned but not presented concurrently, allowing us to isolate the influence of visually driven expectations on the incoming auditory information without a bottom-up conflict. In some trials, the sound matched the expected material, but in a subset, it was incongruent, violating expectations elicited by the preceding visual information. Across both experiments, participants took longer to respond on incongruent than congruent trials, suggesting increased processing demands. In the rating task, incongruent trials also shifted material judgments, such that ratings reflected a weighted combination of incoming auditory information and visually driven predictions, with large individual differences in relative cue weighting. These findings suggest that priors on material properties from one modality, specifically vision, not only establish high-level expectations within the modality about an objects future state, but also extend across modalities.
Sarkar, A.
Show abstract
Young adults frequently report cognitive complaints often attributed to sleep loss alone. However, subjective cognitive functioning is shaped by broader lifestyle and affective factors. Cross-sectional data were analyzed from 530 young adults (mean age 22.1 +/- 2.3 years) to examine the independent, interactive, and cumulative associations of short sleep duration, low physical activity, and psychological distress with everyday cognitive failures. Cognitive failures were strongly associated with sleep duration, physical activity, sleep quality, and distress in univariate analyses. However, hierarchical regression revealed that psychological distress, poor sleep quality, and short sleep duration were the dominant independent correlates of cognitive failures, collectively explaining a substantial proportion of variance in Cognitive Failures Questionnaire scores (R-squared = 0.585, p < 0.001). In contrast, the apparent protective effect of physical activity was not observed after adjustment for sleep and distress (p = 0.976), and no significant sleep-by-physical activity interaction was observed. Further, cumulative risk modeling demonstrated a robust dose-dependent relationship, with cognitive failures increasing progressively as behavioral and psychological risk factors accumulated (p < 0.001). Individuals exposed to all three risk factors exhibited more than double the cognitive failure burden observed in individuals with no risk factors. These results indicate that the cognitive burden in young adults can best be described by an additive increase of behavioral and psychological risk factors as a function of the co-occurrence, rather than by the presence of compensatory effects of lifestyle risk factors. Interventions aimed at preserving cognitive function may therefore benefit from simultaneously targeting sleep health and psychological well-being rather than relying on physical activity alone to offset cognitive burden.